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Abstract 

We provide a complete characterization of the achievable distortion region for the problem of sending a bivariate 
Gaussian source over bandwidth-matched Gaussian broadcast channels, where each receiver is interested in only one 
\ component of the source. This setting naturally generalizes the simple single Gaussian source bandwidth-matched 

broadcast problem for which the uncoded scheme is known to be optimal. We show that a hybrid scheme can 
^ ' achieve the optimum for the bivariate case, but neither an uncoded scheme alone nor a separation-based scheme 

alone is sufficient. We further show that in this joint source channel coding setting, the Gaussian setting is the 
worst scenario among the sources and channel noises with the same covariances. 



Index Terms 

Q ' Gaussian source, joint source-channel coding, squared error distortion measure. 

> ■ I. Introduction 

^ ■ It is well known that Shannon's source-channel separation result for point-to-point communication 
O does not hold for in general for multi-terminal systems, and thus joint source-channel coding may be 
^ required to achieve the optimum. One simple yet intriguing scenario where source-channel separation is 
O known to be suboptimal is broadcasting Gaussian sources on Gaussian channels. 

!• . When a single Gaussian source is at the encoder, the achievable distortion region is known when 
the source bandwidth and the channel bandwidth are matched O, for which a simple analog scheme 
^ is optimal. However when the source and channel bandwidths are not matched, exact characterization 
■ ■ ' of the achievable distortion region is not known. The best known coding schemes are based on joint 
source-channel using hybrid signaling lO, JH, and approximate characterizations were given in [5]; see 
references therein for related works. As a simple extension to this problem of single Gaussian source 
broadcasting, when the source is a bandwidth-matched bivariate Gaussian and each decoder is interested 
in one source component, only partial characterization is known when uncoded scheme is shown to be 
optimal under certain signal-to-noise ratio conditions O. 

In this work, we provide a complete characterization of the achievable distortion region for broadcasting 
bivariate Gaussian sources over Gaussian channels when each receiver is interested in only one component, 
where the source bandwidth and the channel bandwidth are matched. We further show that in this joint 
source channel coding setting, the Gaussian problem is the worst scenario among the sources and channel 
noises with the same covariances, in the sense that any distortion pair that is achievable in the Gaussian 
setting is also achievable for other sources and channel noises. Our work is built on the outer bounds 
given in ||6l and we show that a hybrid coding scheme (different from the one given in [7J proposed for 
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Fig. 1. Broadcasting bivariate Gaussian sources. 

the same problem) can achieve the outer bounds. Our main contribution in this work is this new coding 
scheme and a detailed and systematic analysis of the inner and outer bounds, which result in a complete 
solution. To the best of our knowledge, this is the first case in the literature that a hybrid scheme is 
shown to be optimal for a joint source-channel problem, whereas neither an uncoded scheme alone nor a 
separation-based scheme alone is optimal. 

II. Problem Definition 

Let {S'i(2), S'2(^)} be a memoryless and stationary bivariate Gaussian source with zero mean and 
covariance matrix 



pa'' a2 



(1) 



where without loss of generality, we can assume p > 0. The vector {S^{V), Sk{2), Sk{n)) will be written 
as SJ^ for k = 1,2. We use IR to denote the domain of reals. The Gaussian memoryless broadcast channel 
is given by the model 



Yfc — X + Zk, k — 1,2, 



(2) 



where is the channel output observed by the k-th receiver, and is the zero-mean independent 
additive Gaussian noise in the channel. Thus the channel is memoryless in the sense that {Zi(i), Z2{i)) is 
a memoryless and stationary process. The variance of Zk is denoted as Nk, and without loss of generality, 
we shall assume Ni < N2. Throughout the paper, we use natural logarithm. 

The mean squared error distortion measure is used, which is given by d{s]^, s^) = J21=ii-^kii)—Skii))'^ 
for k = 1,2. The encoder maps a source sample block (S"", S2) into a channel input block X"; the decoder 
observing channel output block reconstruct the source 5"^ within certain distortion; see Fig. \T\ The 
channel input X is subject to an average power constraint. More formally, the problem is defined as 
follows. 

Definition 1: An (n, F, rfi, ^2) bivariate Gaussian source-channel broadcast code is given by an 
encoding function 



(3) 



2 



such that 

-j2nx{i)r<p, (4) 

1=1 

and two decoding functions 

k^l,2, (5) 

and their induced distortions 

dk^Ed(S^,gk(m,S^) + Z^)), k^l,2. (6) 

where E(-) is the expectation operation. 

In the definition, + in the expression /(S*", S2) + Z'^ is understood as the length-n vector addition. It is 
clear that the performance of any Gaussian joint source-channel code depends only on the marginal 
distribution of {S^,S^,X",Y^), but not the joint distribution {S^,S^,X",Y{',Y^). Note that this 
implies that physical degradedness does not differ from statistical degradedness in terms of the system 
performance. Since the Gaussian broadcast channel is always statistically degraded, we can assume 
physical degradedness without loss of generality. 

Definition 2: A distortion pair {Di, D2) G [R+ x [R+ is achievable under power constraint P, if for any 
e > and sufficiently large n there exists an [n, P, d-i, ^2) bivariate Gaussian source-channel broadcast 
code such that 

Di + e>di, 1 = 1,2. (7) 



The collection of all the achievable distortion pairs under power constraint P for a given bivariate 
source is denoted by V{P,a'^,p,Ni,N2), and this is the region we shall characterize in this work. In 
fact, we shall determine the following function which clearly provides a characterization of the achievable 
distortion region. 

D2{P,a\p,Ni,N2,Di)= min ^2- (8) 

{Dud2)€V{P,a'^,p,NuN2) 

Note that V(P,a'^,p,Ni,N2) is a closed set, and thus the minimization above is meaningful. Since the 
minimum Di that is achievable is given by 

when the second receiver is completely ignored, the function D2{P,<7^,p,Ni,N2,Di) is thus only 
meaningfully defined on the domain [-D]"'°, 00]. 

When the source is not Gaussian but with the same covariance structure, and the channel noises 
are not Gaussian, but has the same variances, we shall denote the achievable distortion region as 
T>*{P,a'^, p, Ni, N2). We shall show that the Gaussian setting has the worst case property, and thus the 
Gaussian scheme is a "robust" scheme. 
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III. Main Result 

The main result of this paper is summarized in the following theorem. 
Theorem 1: If Di > Dj^^^^, where Dj"^^ = then 



D2{P,a^p,N,,N2,D^) = a' 



P + N2 



jmaxj 



If ^ < then in the range Di e [Df'\ D\ 

D2{P, a\ p, iVi, iVa, D^) = D^{P, a\ p, iV^, N^, D,), 

where 

D^iP,a^p,N^,N,,D^) 



(10) 



(11) 



DijP + N,) iVi 
Pa2 P 



p2 ,(P + A^i)Di iVi,V(l-p2)P 



l-p2 



Pa2 



iV2 



PV P + A^a P + N2 



(12) 



On the other hand if P > then 



+ nmaxl 



D2{P,a^p,N,,N2,D,] 



where 



D!^iP,a\p,N,,N2,D, 



D-{P, a\ p, iVi, iV2, A) 1^1 G [Dr , ^r) U {Dt, D 
D!^{P,a^p,N,,N2,Di) A e [D^,Dl 

N,{l-p')a' 



(13) 



P + N2 



+ N2-N1 



(14) 



and 



[P + 2iVi)(l - p^) - v/(p2 - (P + 2iVi)V2)(i _^ 
2(P + A^i) 

:P + 2iVi)(l - p2) + v/(p2 - (P + 2iVi) V)(l - ^ 
2(P + A^i) 



(15) 
(16) 



Remark: Depending on the power constraint, the achievable distortion region may have two operating 
regimes. In the regime where D2{P,a'^,p,Ni,N2,Di) = DI^^P, a"^ , p, Ni, N2, Di), the uncoded scheme 
given in [6] is optimal, whereas in the regime D2{P,a'^,p,Ni,N2.,Di) = D2 (P, cr^, p, A'^i, A^2, -Di), a 
hybrid scheme given in the next section is optimal, but the uncoded scheme is not. Typical achievable 
distortion regions for these two cases will be illustrated in the next section after the hybrid coding scheme 
is given, where more observations regarding these schemes can be discussed. 

Consider a source pair {81,82) whose covariance is given by ([U), and channel noise pair (Zj^jZg) 
whose variances are given by (A^i, A''2). We have the following theorem. 

Theorem 2: If (Di, D2) G V{P, a^, p, N^, N2), then (Di, D2) G V*{P, a\ p, A^^, N2). 

This theorem essentially says the Gaussian setting has the worst sources and channels among those 
having the same covariance structure, a result similar to the well-known ones that the Gaussian source is 
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the worst source BUl (Ex. 13.8) and the Gaussian channel is the worst channel [HI (Ex. 10.1). 
The proofs of Theorem [T] and Theorem [2] are given in the next section. 

IV. Proof of the Main Result 

In this section, we shall first review some previous results which provide partial characterization of the 
achievable distortion region, then give a new hybrid coding scheme, which provides the missing portion 
of the characterization. Finally, we provide a proof for the worst-case property of the Gaussian setting. 

A. Preliminaries and Previous Results 

It is straightforward to show that a simple analog scheme by sending 5*2 directly (after certain scaling) 
achieves the distortion pair (see also [i6|) 

= a^il^i^l^±^ = , and D. = a^^^, (17) 
^ P + Ni ^ ' ^ P + N2 

for which D2 cannot be reduced even when the first receiver is not present. Thus we trivially have 

D,{P,a\p,N„N2,D,) = a'j^^, if I^i > (18) 

Thus we only need to characterize the function D2{P, a^, p, A^i, A^2, ^1) when Di G [D'^''', D^""]. 

The uncoded scheme was investigated thoroughly in [[61, which was shown to be optimal under certain 
conditions. More precisely, the uncoded scheme uses the single letter mapping 



where a E [0, 1] and (3 = 1 — a. The reconstruction in this uncoded scheme is thus naturally the single 
letter mapping given by E[Sk{i)\Yk{i)] for k = 1,2. The distortion pair is thus given by 



Di(a,/3) = 



(P + A^i)(a2 + 2a/?p + ^2) p + 
Pa^l-p") ^ N2 



(20) 
(21) 



_(P + A^2)(a2 + 2a/?p + ^2) ' p + 
The main result of |l6l is the following theorem. 

Theorem 3 (Theorem 1, 1^): For any (Di, D2) E V{P,(7'^, p, Ni, N2), and 

^<^(A,a^p), (22) 

iVi 

there exist a*,/?* > such that 

< ^1, and D2{a*,(3*) < D2, (23) 

where the threshold T is given by 

T{D„a',p) = { iM^HT^^P^) U < iJ^ < a (1 - p ), ^^4) 

+00 otherwise. 
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This result partially characterizes the achievable distortion region V(P,a'^,p,Ni,N2), or equivalently 
the function D2{P, a"^ , p, Ni, N2, Di). Later we shall translate it into a more convenient form, such that 
by combining all the portions, the function D2{P, cr^, p, Ni, N2, Di) can be characterized completely. 

Also inherent in the proof of is a genie-aided outer bound, where the source 5*2 is given directly 
to the decoder observing Yi; see Fig. |2l This outer bound, which is a special case of the more general 
outer bound given in [|6l, was rederived in a simpler manner in [|71; the general outer bound in H is more 
involved, and it usually requires optimization over several parameters. Let us follow the notation in [|71 
and denote the achievable distortion (Di, D2) in the genie-aided setting as (i?i|2, D2), and the simplified 
characterization of the achievable distortion region in [|7]| is as follows. 

Theorem 4: The achievable (-Di|2, D2) when 5*2 is present at the first receiver is all the pairs 



Dl\2> 



a 



'1 



aP 
Ni 



and 



Do > 



a 



1 + 



(l-a)P 



(25) 



aP+N2 

for some a G [0,1]. 

As we shall show in the next subsection, this genie-aided outer bound is in fact tight for a certain 
regime. Intuitively speaking, since the first receiver is stronger than the second receiver, and S2 is not 
required at the first receiver, the information S'2 is redundant at the first receiver in a certain sense, and 
thus we can expect the genie-aided outer bound to be reasonably good. 



B. A Hybrid Coding Scheme 

The coding scheme we propose is a hybrid one, where the channel input is given by 

X" = aSl + ~pSli + X^, (26) 

where X'2 is (roughly) the quantized version of source sequence S'2 after some proper scaling; is the 
digital portion of the channel input, and a, /3 > are two scaling parameters to be specified later. 
More precisely, consider the single-letter distribution 

Xd = i{S2 + U), (27) 

where ^ is a zero mean Gaussian random variable independent of everything else with variance Q, and 
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7 > is again a scaling parameter to be specified later. Since ^ S2 ^ {Si, S2) is a Markov string, 
the joint distribution of (5*1, 5*2, X^, X, Yi, Y2) is uniquely determined, and they are jointly Gaussian. We 
also need to define the coefficients ak and bk 

E[Sk\Xd, aSi + PS2 + Zu] = afcX, + + + ^fc), k = I, 2. (28) 

This proposed hybrid scheme in this work is somewhat similar to the scheme given in fS] for joint 
source channel coding on the multiple access channel. In what follows, we only outline the coding scheme 
and some important analysis steps, but omit the rather technical detailed proof (a rigorous proof can be 
straightforwardly adapted from that given in |[8l). 

• Codebook generation: generate exp(ni?) codewords single-letter wise according to the marginal 
distribution of X^, this codebook is revealed to both the encoder and decoders. 

• Encoding: find a sequence in the codebook that is jointly typical with the source sequence Sl^; 
if successful, the transmitter sends X" = aS^ + $82 + X^- 

• Digital decoding: the fc-th decoder tries to find a unique X^ codeword in the codebook that is jointly 
typical with the decoder also recovers the sequence aS^ + /JS'g + Z]^ after removing the digital 
codeword. 

• Estimation: if the digital decoding succeeds, then the decoder reconstructs the respective source 
sequence as Sk{i) = akXd{i) + hk{aSi{i) + JiS2{i) + Zk{i)). 

An error occurs in the above scheme if the encoder fails to find a codeword that is jointly typical with 
5*2 , or one of the decoders fails to find the correct digital codeword. Note that due to the Markov string 
Xd^ 82^ {81,82), we indeed have that the chosen X^ is jointly typical with {8"^ , 81^ , X'\Yl' ,Y;') 
with high probability in the above scheme. Because the second receiver is a degraded version of the first 
receiver, the error probability can be made arbitrarily small if the following condition holds (after ignoring 
the 5's often seen in the typicality argument) 

I{82\X,)<R<I{X,-Y2). (29) 
Furthermore, to ensure the power constraint is not violated, we need 

a' (a' + + 2paj3) + f (a' + Q) + 2^a^ {ap + j3)<P. (30) 

It is evident that as long as 

cT^(a^ + + 2pa/3) < P, (31) 

we can find 7 = 7* such that (1301) holds with equality, because the left hand side of (l30l) is monotonically 
increasing in 7 in the range [0, 00], and we shall choose precisely this value in the scheme. 
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With this choice of 7, (|29l ) can be simplified. Note that 

I{Xd;Y2) = h{Y2)-h{Y2\Xd) 

= h{Y2) - h{aSi + I3S2 + X, + (32) 

= h{Y2)-h{aSi + l3S2 + Z2\Xd) (33) 

= ^ log27re(P + TVs) - + /352 + ^2!^^) (34) 

= ^ log27re(P + X2) - K&Si + ^S^s + ^21^2 + ?7). (35) 



Moreover, we have also 



/(^2; X,) = 1(82; S2 + U) = ^ log (36) 



Putting (1351) and (1361) together, (1291) finally reduces to the following expression through some algebraic 
calculation 

Q>a^ (l-pW + iV2 ^ 
P - (52 + /32 + 2a/3p)cr2 

We shall thus choose Q = Q* in the scheme (again ignoring some asymptotically small S terms). 

By the joint typicality of the sequences when digital decoding succeeds, the distortions can be computed, 
which is summarized in the following theorem. 

Theorem 5: For a, (3 > such that 

+ /3^ + 2pa/3) < P, (38) 

the proposed hybrid scheme can achieve the distortion pair {D^, D2) 

[1 - p2)[iViP - (^2 + 2a^p)iVia2 + ^^N2a'' + (1 - p'')a^^^a^] + N,N2 



= a 



[1 - p^)a^{P + Ni)a^ + PNi + N1N2 + {a^ + + 2aPp){N2 - Ni)a 



2 ■ 



^ P + N2 

It is not clear a priori why in the analog part, the source 5*2 needs to be included. However, this is 
rather critical, as we shall discuss shortly in the next section. 



C. Matching the Inner and Outer Bounds 

The proof of the main result is now organized into three propositions. We start by rewriting Theorem 
[3] in the following form. 
Proposition 6: We have 

, If p < ^^^^1, then the uncoded scheme is optimal in the range Di e [Df''^,Df'^''] and 

D2(P, a', p, iVi, N2, Di) = D^{P, a\ p, N,, N2, D^); 
. If P > then the uncoded scheme is optimal over the range P>i G [Df''\ ] U [D^, D'^''% and 

in this range D2(P, a\ p, iVi, ^2, ^1) = D1^{P, a\ p, iVi, N2, D,). 
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Proof: This proposition is a direct consequence of Theorem [3l It is straightforward to show that 
when P < '^jzf, the condition in (|22|) holds for any choice of Di by analyzing the quadratic inequality 
(see [|6|| Corollary 1); on the other hand, when P > ^f^, (|22l) only holds in the given range. ■ 

Given this alternative form, we only need to focus on the case that P > and moreover, in the range 
Di e [Df , D^]. It is worth noting that it is always true that Df'' < < < {1 - p^)a^ < DJ"^^. 

Next we use Theorem |4] to write an lower bound for the function D2{P, a'^, p, Ni, N2, Di). 

Proposition 7: For any E 0"^^% D2(P, a^, p, N-^, N2, Di) > D!^{P, a^, p, N^, N2, D^). 

This proposition is a direct consequence of the fact that the achievable (-Di|2,^2) region given 
in Theorem |4] is an outer bound for V(P,a'^,p,Ni,N2); the proof is obtained by simple algebraic 
manipulation to eliminate the parameter a in Theorem HI and we thus omitted the details. 

The following proposition is the final piece for the proof of the main result. 

Proposition 8: The proposed hybrid scheme achieves 

D2{P, a\ p, iVi, iV2, Di) = D'i{P, a\ p, TVi, iVs, I^i), (40) 
when Di E [D^ , D^] by choosing 




Ni 

«= 1/7^ -^5(5^ (41) 

a(l — p'')a^ 

Proof: In order to prove this proposition, we need to show firstly that the given choice of (a, /?) does 
not violate the power constraint, i.e., the condition (|3TI) is satisfied; secondly, the given choice of (ct, f3) 
reduces the distortion pairs in (|39| ) to those given in (|40l) . 

Notice that a and /3 given in (|4TI) and (l42l) are well-defined and non-negative when Di E [D^ , Df] , 
since Di < (1 — p^)a^ in this range. For (|3TI) to hold, we need to have 

a^ + (3' + 2al3p = + \ ^ + ^ ^\ , < -. (43) 

a"^(l — p^j'^a* (1 — p^jcT'^ cr^ 

Solving the inequality gives that the necessary and sufficient condition that 

(1 - p^)P - 2p^N, - v/(p2 _ (p + 2iVi)2p2)(i _ 
2(1 -p2)a2 

(1 - p^)P - 2p'N, + v/(p2 _ (p + 2N,yp^){l - p2) 
- 2(l-p2)a2 ■ ^ ^ 

Substituting (|4T1) into (|44|) and after certain algebra, we arrive at the conditions under which (l44l) is true, 
which is exactly Di E [D^ , Df]. 

In order to show that the lower bound as stated in Proposition |7] can be achieved, we first simplify the 
expression of given in (|39| ) in terms of a, which (after quite some algebra) eventually gives 

f,h _ ^2 (1 - P')Ni 

{l-p^)a^a^ + N,- ^^^^ 
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Substituting our choice of a given in (|4TI) into (|45] ) leads to = Di\ again substituting (|4TI) into the 
expression of D\ in (|39| ) gives the expression stated in the proposition, which completes the proof. ■ 

Readers may wonder how the magic value of /? was found, which optimizes D\ in the hybrid scheme. 
Indeed, directly optimizing the distortion ]D\ is extremely cumbersome[J. To circumvent this difficulty, we 
instead solve for /3 such that the inner bound matches the outer bound, which gives the given expression. 
This approach is less intuitive, since it is possible that neither the genie-aided outer bound nor the hybrid 
scheme inner bound is tight, however extensive numerical comparison indeed suggested that these bounds 
match, which motivated us to take such an approach. 

In Fig. |3] and Fig. |4] we give two typical achievable distortion regions, where for comparison we 
also include the performance of a simple separation-based scheme where the digital broadcast messages 
encoding S2 and S\ (conditioned on the reconstructed S-i), respectively. In both figures, each horizontal 
red line is the performance of the hybrid scheme by varying /3 while keeping a fixed. Note that the 
hybrid scheme includes the uncoded scheme as a special case when the digital portion is allocated no 
power. Fig. [3] is plotted with the choice of source and channel satisfying the condition P < and 
thus the uncoded scheme is always optimal. For this case, adding digital code in the hybrid scheme is 
always inferior. In contrast. Fig |4] is plotted under the condition P > "^jzf^ ^i^d thus uncoded scheme is 
only optimal at high and low Di regimes. In the regime that uncoded scheme is not optimal, it can be 
seen that even when analog portion does not include 5*2, the hybrid scheme can sometimes outperform 
the uncoded scheme, however, by optimizing ^2 in the analog portion, the inner and outer bounds indeed 
match. Moreover, observe that the distortion of D'l achieved by the hybrid scheme is not monotonic in 
/3 when a is fixed (each red line), where the two extreme values of (5 give the uncoded scheme and the 
hybrid scheme without analog S2, respectively. 

D. The Worst Case Property 

Next we prove Theorem [2l i.e., the worst case property of the Gaussian setting. 

Proof of Theorem |2l- We have shown an optimal scheme in the Gaussian setting is the proposed 
hybrid scheme, and thus we can limit ourselves to the distortion pairs achievable by this scheme. In fact 
we shall continue to use this scheme and the associated parameters when the sources and channel noises 
are not Gaussian. More precisely, we shall now use instead of Xd to construct the digital source 
codewords 

Xl = ^{S; + U), (46) 

where U is still a Gaussian random variable with variance of Q*, independent of everything else. The 
overall covariance structure of the scheme remains intact as in the Gaussian case, and thus the same 
(MSE) distortion pairs can be achieved, as long as the digital codewords can be correctly decoded at both 
the decoders, i.e.. 



i{s;-xi)<i{x:-y:), 

'in fact we were not able to find the optimal solution for /3 this way. 



(47) 




Fig. 3. A typical achievable distortion region when P < . Here P = 1, A^'i = 0.3, 7V2 = 1 and p = 0.8. 



with our choices of the parameters, where Y* is the channel output in this non-Gaussian setting. Note 
that unlike in the Gaussian case, here the broadcast channel is not necessarily degraded, and thus we also 
need to make sure that the codeword can be correctly decoded at the first decoder. 

To show the second decoder can succeed (with high probability), we only need to observe that 

i{s;; X*) - i{x*; Y*) = h{x:\Y*) - h{x*\s;) 

= h{X*\Y*) - h{W) 

<M^*-e(x*|f;))-mw) 

<h{Xd-^Xa\Y2))-h{W) 

= h{Xd\Y2) - HW) 

= I{S2;X,)-I{X,;Y,) = 0, (48) 

where in the second inequality we substitute Xd of the Gaussian version of the problem, because the 
terms have the same covariance structure, and Gaussian distribution maximizes the differential entropy; 
in the last but one equality, we add and subtract the same term h(X(i), and the last equality is due to our 
specific choice of the parameters in the Gaussian problem. 




0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 



Fig. 4. A typical achievable distortion region when P > ^^r^. Here P = 1, A'^i = 0.3, 7V2 = 1 and p = 0.4. 

Similarly, we can write 

J(5*; X*,) - I{X*- Y*) < I{S2; X,) - J(X,; Y,) < I^S^; X,) - I{X,; Y^) < 0, (49) 

where the second inequality is guaranteed by the relation in the Gaussian case, which is indeed a degraded 
broadcast channel. This completes the proof. ■ 

V. Concluding Remarks 

We provide a complete solution for the joint source-channel coding problem of sending bivariate 
Gaussian sources over Gaussian broadcast channels when the source bandwidth and channel bandwidth 
are matched. Thus this problem joins a limited list of joint source-channel coding problems for which 
complete solutions are known. Possible extension of this work includes the case with more than two users 
or more than two sources, and approximate characterization for bandwidth mismatched case, which are 
part of our on-going work. 
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